Analysis of Head Gesture and Prosody Patterns for Prosody-Driven Head-Gesture Animation

Gesture Prosody Integration in Pragmatic Processing

Prosody-assisted head-driven access to spoken German compounds.

Auditory processing of German 2-noun compound words was investigated with 328 participants in 4 experiments by monitoring semantic priming effects of the left constituents of the compound words. The authors demonstrated that there is no primacy of the left constituents in accessing auditorily presented German compound words in the mental lexicon. A clear priming effect of left constituents occu...

Prosody and hand gesture at turn boundaries in Swedish

In order to ensure smooth turn-taking between conversational participants, interlocutors must have ways of providing information to one another about whether they have finished speaking or intend to continue. The current work investigates Swedish speakers’ use of hand gestures in conjunction with turn change or turn hold in unrestricted, spontaneous speech. As has been reported by other researc...

Spatiotemporal-Boosted DCT Features for Head and Face Gesture Analysis

Automatic analysis of head gestures and facial expressions is a challenging research area and it has significant applications in humancomputer interfaces. In this study, facial landmark points are detected and tracked over successive video frames using a robust method based on subspace regularization, Kalman prediction and refinement. The trajectories (time series) of facial landmark positions ...

Gesture Theory is Linguistics: On Modelling Multimodality as Prosody

Prosody and gesture have, with few exceptions, not appealed to computational linguists, and there is even less awareness of the parallels between them, though in modelling sign languages of the hearing-impaired, the linguistic metaphor of gesture patterns as ‘phonology’ has been very fruitful. On the other hand, many disciplines from anthropological linguistics to robotics are currently occupie...